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Abstract — It has previously been shown that ensembles of 
terminated protograph-based low-density parity-checlt (LDPC) 
convolutional codes have a typical minimum distance that grows 
linearly with block length and that they are capable of achieving 
capacity approaching iterative decoding thresholds on the binary 
erasure channel (BEC). In this paper, we review a recent 
result that the dramatic threshold improvement obtained by 
terminating LDPC convolutional codes extends to the additive 
white Gaussian noise (AWGN) channel. Also, using a (3,6)- 
regular protograph-based LDPC convolutional code ensemble as 
an example, we perform an asymptotic trapping set analysis of 
terminated LDPC convolutional code ensembles. In addition to 
capacity approaching iterative decoding thresholds and linearly 
growing minimum distance, we find that the smallest non-empty 
trapping set of a terminated ensemble grows linearly with block 
length. 

1. Introduction 

Ensembles of low-density parity-check (LDPC) block codes 
can be obtained by terminating LDPC convolutional code 
ensembles U, fSJ. The slight irregularity resulting from the 
termination of the convolutional codes has been shown to 
lead to substantially better belief propagation (BP) decoding 
thresholds compared to corresponding block code ensembles. 
More recently, it has been proven analytically for the binary 
erasure channel (BEC) that the BP decoding thresholds of 
some slightly modified regular LDPC convolutional code 
ensembles approach the maximum a posteriori probability 
(MAP) decoding thresholds of the corresponding LDPC block 
code ensembles |3|. Figure [T] displays the simulated perfor- 
mance of terminated (3, 6)-regular and (4, 8)-regular LDPC 
convolutional codes over the additive white Gaussian noise 
(AWGN) channel and serves as a demonstration of the capabil- 
ities of these codes and as motivation for the results presented 
in this paper Here, the termination length has been chosen 
such that the code rate is i? = 0.49. We note in particular 
that as J increases, the thresholds and corresponding waterfall 
performance of the simulated codes improves. 

In addition to this excellent threshold performance, it can 
also be shown that the minimum distance typical of most 
members of these terminated LDPC convolutional code en- 
sembles grows linearly with the block length as the block 
length tends to infinity, i.e., they are asymptotically good Q. A 
large minimum distance growth rate indicates that codes drawn 
from the ensemble should have a low error floor under max- 
imum likelihood (ML) decoding. However, when sub-optimal 
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Fig. 1: AWGN channel performance of terminated (3,6)- 
regular and (4,8)-regular LDPC convolutional codes with lift- 
ing factor N = 6000 and rate R = 0.49. For comparion, (3,6)- 
regular LDPC block codes with N = 6000 and N = 200000 
are also shown. 

decoding methods are employed, there are other factors that 
affect the performance of a code. For example, it has been 
shown that so-called 'trapping sets' are a significant factor 
affecting decoding failures of LDPC codes over the AWGN 
channel with iterative message-passing decoding. Trapping 
sets, graphical sub-structures existing in the Tanner graph of 
LDPC codes, were first studied in Known initially as 
near-codewords, they were used to analyse the performance 
of LDPC codes in the error floor, or high signal-to-noise 
ratio (SNR) region, of the bit error rate (BER) curve. In 
||6l, Richardson developed these concepts and proposed a 
two-stage technique to predict the error floor performance of 
LDPC codes based on trapping sets, and asymptotic results on 
average trapping set distributions for both regular and irregular 
LDPC block code ensembles appeared in |7|. 

In this paper, we perform an AWGN channel analysis of 
terminated LDPC convolutional codes. We begin in Section Hill 
by briefly reviewing a recent result that the dramatic threshold 
improvement obtained by terminating LDPC convolutional 
codes on the BEC also extends to the AWGN channel. This 



result is demonstrated for a variety of asymptotically good, rate 
R = 1/2 (J, 2 J)-regular LDPC convolutional code ensembles 
and for a rate i? = 1/2 irregular LDPC convolutional code 
ensemble based on the accumulate-repeat-jagged-accumulate 
(ARJA) block protograph El. In Section |IV] using a (3,6)- 
regular protograph-based LDPC convolutional code ensemble 
as an example, we perform an asymptotic trapping set analysis 
of terminated LDPC convolutional code ensembles. Here, 
using techniques developed by Abu-Surra, Ryan, and Divsalar 
||9l , asymptotic methods are used to calculate a lower bound 
on the trapping set numbers of terminated (3, 6)-regular LDPC 
convolutional code ensembles. These trapping set numbers 
define the size of the smallest, non-empty trapping sets in 
an ensemble. Concluding remarks are given in Section |V] 

II. Constructing protograph-based LDPC 

CONVOLUTIONAL CODES 

A protograph |[T0) is a small bipartite graph B = {V, C, E) 
that connects a set of n„ variable nodes V = {uq, . • . , 
to a set of Tic check nodes C = {cq, . . . , c„^_i} by a set of 
edges E. The protograph can be represented by a parity-check 
or base biadjacency matrix B, where B^^y is taken to be the 
number of edges connecting variable node Vy to check node 
Cx- The parity-check matrix H of a protograph-based LDPC 
block code can be created by replacing each non-zero entry in 
B by a sum of B^.y permutation matrices of size N and a zero 
entry by the NxN all-zero matrix. In graphical terms, this can 
be viewed as taking an A^-fold graph cover lITTI or "lifting" of 
the protograph. It is an important feature of this construction 
that each lifted code inherits the degree distribution and graph 
neigbourhood structure of the protograph. The ensemble of 
protograph-based LDPC codes with block length n = Nuy 
is defined by the set of matrices H that can be derived from 
a given protograph by all possible combinations of N x N 
permutation matrices. 

A. Convolutional protographs 

An ensemble of unterminated LDPC convolutional codes 
can be described by means of a convolutional protograph [I] 
with base matrix 
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where denotes the syndrome former memory of the 
convolutional codes and the be x by component base matrices 
Bi, i = 0, . . . , Tils, represent the edge connections from 
the by variable nodes at time t to the he check nodes at 
time t + i. Starting from the base matrix B of a block 
code ensemble, one can construct LDPC convolutional code 
ensembles that maintain the same degree distribution and 
structure as the original ensemble. This is achieved by an 
edge spreading procedure (see IT] for details) that divides the 



edges from each variable node in the base matrix B among 
7Jis + 1 component base matrices B^, i — 0, . . . ,ms, such 
that the condition Bq + Bi + • ■ • + B,„^ = B is satisfied. 
This ensures that the computation trees of the convolutional 
code ensemble are equal to those of the original block code 
ensemble defined by B. An ensemble of (in general) time- 
varying LDPC convolutional codes can then be formed from 
B[_ 00,00] using the protograph construction method based on 
NxN permutation matrices described above. 

For example, a (3,6)-regular LDPC convolutional ensemble 
with rris = 2 can be formed from the block base matrix B = 
[3 3 ] by defining the component base matrices 



Bo=[l l]=Bi=B2, 
with corresponding convolutional base matrix 
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B. Terminated LDPC convolutional code ensembles 

Suppose that we start the convolutional code with parity- 
check matrix defined in ([T]) at time t ~ and terminate it 
after L time instants. The resulting finite-length base matrix 
is then given by 

Bn 
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(3) 



The matrix B[o,l-i] can be considered as the base matrix 
of a terminated protograph-based LDPC convolutional code 
ensemble. Termination in this fashion results in a rate loss. 
Without puncturing, the design rate Rl of the terminated code 
ensemble is equal to 

' L + rris \ be _ f L + to., 
by 



Rl = 1 



L 



1 



L 



(1 - i?) , 



where i? = 1 — Nbc/Nby = 1 — be /by is the rate of 
the unterminated convolutional code ensemble. Note that, as 
the termination factor L increases, the rate increases and 
approaches the rate of the unterminated convolutional code 
ensemble. 

111. Iterative decoding thresholds and minimum 
distance growth rates of terminated ensembles 

Terminated LDPC convolutional code ensembles have been 
observed to display BP thresholds that approach the MAP 
decoding threshold of the corresponding block code ensembles 
for the BEC as the termination factor L tends to infinity 
HI, IIT2I . and recently this has been proven analytically for 
(J, i4r)-regular ensembles |I3|. In this section, we review a more 




Fig. 2: AWGN thresholds and typical minimum distance growth rates for families of terminated (J, 2 J)-regular LDPC 
convolutional code ensembles, terminated ARJA LDPC convolutional code ensembles, and associated LDPC block code 
ensembles. 



recent result that the dramatic threshold improvement obtained 
by terminating LDPC convolutional codes also extends to 
the AWGN channel ITSl . lfT4l . Since exact density evolution 
is far more complex for the AWGN channel than for the 
BEC, we make use of the reciprocal channel approximation 
(RCA) technique introduced in ifTSl . which has been succes- 
fully applied to the analysis of protograph ensembles in ISj. 
With this approach, the calculation of approximate AWGN 
channel thresholds for large protographs becomes feasible with 
reasonable accuracy. Typical minimum distance growth rates 
for protograph-based terminated LDPC convolutional code 
ensembles can be calculated using the techniques presented 
by Divsalar 11161 . 

Figure |2] displays the calculated AWGN thresholds and 
minimum distance growth rates for the terminated LDPC 
convolutional code ensembles and the corresponding LDPC 
block code ensembles. The (J, 2 J)-regular terminated LDPC 
convolutional base matrices are given by (|3}, where the 
be X by ~ 1x2 component submatrices Bj = [1 1 ], 
1 = 0,..., nis, and m,, = J — 1. The terminated convolutional 
ARJA (TARJA) component submatrices Bq and Bi of size 
be X by ~ 3 X 5 aie given as follows: 



Bn 



1 2 
1110 
10 2 



and Bi = 




2 1 
1110 



where we note that 



B 



1 — 



B, 



the block base matrix of the ARJA ensemble, and that the 
variable node associated with column 2 should be punctured. 



We see for the terminated convolutional ensembles that, as 
L increases, the ensemble design rate increases (approach- 
ing R = 1/2 asymptotically) and the thresholds approach 
the Shannon limit. However, for increasing L, the asymp- 
totic minimum distance growth rates S^^^^ of the ensembles 
decrease. This presents the code designer with a trade-off 
between distance growth rate and threshold, along with a 
variety of achieveable code rates Rl. We observe that the 
(J, 2 J)-regular block code ensemble thresholds worsen as we 
increase J. Figure |2] shows that this is also the case for 
the terminated (J, 2 J) -regular convolutional code families for 
small termination factors L. Thus, by increasing J (and hence 
decoding complexity), we obtain a more pronounced trade- 
off between distance growth rates and threshold for small 
values of L. However, as the termination factor L increases, 
we observe that the threshold of the terminated (J, 2 J)-regular 
LDPC convolutional code families converge to a value close 
to capacity and that this value improves as we increase J. This 
indicates that, for large L, both the distance growth rates and 
the thresholds improve with increasing complexity. We would 
expect this trend to continue as we further increase the variable 
node degree J, although the improvement will diminish with 
increasing J. 

Now consider choosing L such that the ensemble design 
rate is i? = 0.49. In this region, the threshold values of the 
(J, 2 J)-regular ensembles improve with J. The thresholds of 
the terminated (3, 6)-regular and (4, 8)-regular ensembles are 
displayed in Fig. [T] along with the simulated performance of 
randomly chosen codes from the associated ensembles with 
permutation matrix size N = 6000. A standard LDPC block 
decoder employing the BP decoding algorithm is used. We 
observe that the waterfall performance is relatively close to 



the threshold and we expect this gap to decrease for larger 
permutation matrix sizes N. By choosing L larger, the rate 
increases (approaching 1/2) and the thresholds move to the 
left. The corresponding waterfall performance of codes chosen 
from these ensembles will also move to the left. As a final 
observation, we note that for all achieveable rates the TARJA 
ensembles have better thresholds than the terminated (3, 6)- 
regular ensembles. This is expected, since the ARJA ensemble 
has been optimised to have a good iterative decoding thresh- 
old. However, we also observe that, for large L, the (4, 8)- 
and (5, 10)-regular terminated ensembles have comparable 
thresholds to the TARJA ensemble, demonstrating the benefit 
that derives from terminating the (J, 2 J) -regular convolutional 
structure. 

Figure |3] plots the typical minimum distance growth rates 
against the threshold gap to capacity (the difference between 
the calculated AWGN channel threshold (Eb/No) of an en- 
semble and capacity for the ensemble design rate) for the 
terminated (J, 2 J)-regular convolutional ensembles with ter- 
mination factors L = + 1, . . . , 16, 20, 50, 100, the TARJA 
ensembles with termination factors L = 2, . . . , 10, the ARJA 
block code ensemble, and the corresponding (J, 2 J)-regular 
block code ensembles. 
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Fig. 3: Typical minimum distance growth rate vs. threshold 
gap to capacity. 

We observe that, in particular, intermediate values of L pro- 
vide thresholds with a small gap to capacity while maintaining 
a small typical minimum distance growth rate with only a 
slight loss in code rate. We also note that, for a fixed gap to 
capacity close to zero, the largest minimum distance growth 
rate is obtained by choosing the terminated (J, 2 J) ensemble 
with the largest J, and that the TARJA ensemble falls in 
between the terminated (3, 6)- and (4, 8)-regular ensembles. 
(In this region, with the gap to capacity close to zero, the 
rates are approximately equal and close to 1/2.) For larger 
fixed gaps to capacity, we see that this ordering changes, and 
the reverse ordering holds for large gaps to capacity. 



IV. Trapping set analysis of terminated LDPC 

CONVOLUTIONAL CODE ENSEMBLES 

In m, MacKay and Postol discovered a "weakness" in 
the structure of the Margulis construction of a (3, 6)-regular 
Gallager code. Described as near-codewords, these small 
graphical sub-structures existing in the Tanner graph of LDPC 
codes cause the iterative decoding algorithm to get trapped in 
error patterns. These weaknesses were shown to contribute 
significantly to the performance of the code in the error floor 
region of the BER curve. Richardson developed this concept 
in 161, and defined these structures as trapping sets. 

Definition 1: An (a, h) general trapping set Ta.b of a bipar- 
tite graph is a set of variable nodes of size a which induce 
a subgraph with exactly h odd-degree check nodes (and an 
arbitrary number of even-degree check nodes). 

In order to calculate ensemble average general trapping set 
enumerators for terminated LDPC convolutional codes, we use 
the combinatorial arguments previously presented in [!9l. The 
technique involves considering a two-part ensemble average 
weight enumerator for a modified protograph with the property 
that any (a, h) trapping set in the original protograph is a 
codeword in the modified protograph. 

A. Trapping set growth rates 

The two-part normalized logarithmic asymptotic trapping 
set spectral shape fimction of a code ensemble can be writ- 
ten as r{a,(3) = limsup„_^^ r„(a, /?), where r„(a,^) = 
in(A„,t,) ^ ^ _ ^1^^ p _ iijji^ (J, ajjd b are Hamming weights, n 

is the block length, and Aa.b is the two-part ensemble average 
weight distribution. Suppose now we are interested in the ratio 
of 6 to a for a general (a, h) trapping set enumerator Let 
A = b/a = P/a, A G [0,oo). As proposed in ||9l, we may 
classify the trapping sets as ta — {Ta.b\b = Aa}. For each A, 
we define dts{^) to be the A-trapping set number, which 
is the size of the smallest, non-empty trapping set in ta. 
Now consider fixing A and plotting the normalized weight 
a against the two-part asymptotic spectral shape function 
r{a,(3) = r{a,Aa). Suppose a > and the first zero- 
crossing of r{a, (3) occurs at a = dts{A). If r{a, jS) is negative 
in the range < a < 5ts{A), then the first zero-crossing 
(5ts(A) is called the A-trapping set growth rate of the code 
ensemble. If 5ts{A) exists we can say with high probability 
that a randomly chosen code from the ensemble has a A- 
trapping set number that is at least as large as n5ts{A), i.e., the 
A-trapping set number increases linearly with block length n 
[i9i. This implies that, for sufficiently large n, a typical member 
of the ensemble has no small trapping sets. 

B. Trapping set analysis of terminated (3, 6)-regular LDPC 
convolutional codes 

As an example, we will consider the terminated (3, 6)- 
regular LDPC convolutional code ensemble described in Sec- 
tion III-AI For each termination factor L, we analyse the two- 
part asymptotic spectral shape function described in Section 
IIV-AI with A > to see if a positive trapping set growth rate 



(A) exists. Note that setting A = (3/ a = b/a = corre- 
sponds to the minimum distance growth rate problem, where a 
and /? are the weights a and b normaHsed by the block length 
n. Thus, S^g^O) ~ Sl^in^ where S^^-^ is the minimum distance 
growth rate of the terminated ensemble as reported in [l4|. As 
A ranges from to oo, the points {5[g\A) , AS['^\A)) trace 
out the so-called zero-contour curve for a protograph-based 
code ensemble 1(9] • The zero-contour curves for terminated 
(3, 6)-regular LDPC convolutional code ensembles are shown 
inFig.|4]forL = 3, ...,12. 
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Fig. 4: Zero contour curves for terminated (3, 6)-regular LDPC 
convolutional code ensembles. 

For all A > 0, we observe Jjf^A) > 0, indicating that, 
for each class of (a, b) general trapping set, the size of the 
smallest non-empty trapping set typical of most members of 
the ensemble is growing linearly with block length. Code 
ensembles with large A-trapping set numbers d[g \A) are the 
most interesting, since small trapping sets dominate iterative 
decoding performance in the error floor 0. Thus we want 
the A-trapping set growth rate sI^\A) to exist and to be 
as large as possible for each value of A. We observe in 
Fig. H that S[^'\A) < (5[f''(A) for any Li > La- This is 
analogous to the decrease in the minimum distance growth 
rate with increasing L (and rate R) observed in 141. These 
results suggest that for larger values of L, where it becomes 
problematic to calculate the trapping set growth rates nu- 
merically, we will observe positive zero-contour curves with 
i5(^^(0) = (5^j^„ > 0, the minimum distance growth rate of 
the terminated ensemble. This promises, for sufficiently large 
block length n, good error-floor performance for terminated 
(3, 6) -regular LDPC convolutional code ensembles in addition 
to the capacity approaching thresholds discussed earlier. 

V. Conclusions 

In this paper we saw that the capacity approaching thresh- 
olds of terminated LDPC convolutional codes, recently es- 
tabUshed for the BEC, also extend to the AWGN channel. 



In addition, the terminated ensembles display linear mini- 
mum distance growth for any finite termination factor L. An 
asymptotic trapping set analysis was performed on a family of 
terminated (3, 6) -regular LDPC convolutional code ensembles 
and it was shown that they possess the property that the 
smallest non-empty trapping set grows linearly with the block 
length. These properties indicate that codes chosen from these 
ensembles should have excellent performance in both the 
waterfall and the error-floor region of the BER curve. 
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